Unsupervised context-based learning of multiple temporal sequences
نویسندگان
چکیده
A self-organizing neural network is proposed to handle multiple temporal sequences with states in common. The proposed network combines context-based competitive learning with time-delayed Hebbian learning to encode spatial features and temporal order of sequence items, respectively. A responsibility function to avoid catastrophic forgetting, and a redundancy mechanism to avoid loss of stored sequences increase the reliability of the model. States shared by different sequences are encoded into a single neuron, whereas, for recall, context information indicates the correct sequence to be followed in the case of ambiguity. Simulations with trajectories of a PUMA 560 robot are performed to test the network accuracy, robustness to noise and tolerance to faults.
منابع مشابه
Merge SOM for temporal data
The recent merging self-organizing map (MSOM) for unsupervised sequence processing constitutes a fast, intuitive, and powerful unsupervised learning model. In this paper, we investigate its theoretical and practical properties. Particular focus is put on the context established by the self-organizing MSOM, and theoretic results on the representation capabilities and the MSOM training dynamic ar...
متن کاملAn Unsupervised Learning Method for an Attacker Agent in Robot Soccer Competitions Based on the Kohonen Neural Network
RoboCup competition as a great test-bed, has turned to a worldwide popular domains in recent years. The main object of such competitions is to deal with complex behavior of systems whichconsist of multiple autonomous agents. The rich experience of human soccer player can be used as a valuable reference for a robot soccer player. However, because of the differences between real and simulated soc...
متن کاملLearning Script Knowledge with Web Experiments
We describe a novel approach to unsupervised learning of the events that make up a script, along with constraints on their temporal ordering. We collect naturallanguage descriptions of script-specific event sequences from volunteers over the Internet. Then we compute a graph representation of the script’s temporal structure using a multiple sequence alignment algorithm. The evaluation of our sy...
متن کاملCompeting Hidden Markov Models on the Self-Organizing Map
This paper presents an unsupervised segmentation method for feature sequences based on competitivelearning hidden Markov models. Models associated with the nodes of the Self-Organizing Map learn to become selective to the segments of temporal input sequences. Input sequences may have arbitrary lengths. Segment models emerge then on the map through an unsupervised learning process. The method wa...
متن کاملContinuous Online Sequence Learning with an Unsupervised Neural Network Model
The ability to recognize and predict temporal sequences of sensory inputs is vital for survival in natural environments. Based on many known properties of cortical neurons, hierarchical temporal memory (HTM) sequence memory recently has been proposed as a theoretical framework for sequence learning in the cortex. In this letter, we analyze properties of HTM sequence memory and apply it to seque...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1999